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Abstract 

We consider any dynamical system that starts from a given ensemble of configurations and evolves 
in time until the system reaches a certain fixed stopping criterion, with the mean first-passage time 
the quantity of interest. We present a general method, Projective Dynamics, which maps the multi- 
dimensional dynamics of the system onto an arbitrary discrete set of states {Cfc}; subject only to the 
constraint that the dynamics is restricted to transitions not further than the neighboring states 
(^k±i- We prove that with this imposed condition there exists a master equation with nearest- 
neighbor coupling with the same mean first-passage time as the original dynamical system. We 
show applications of the method for Brownian motion of particles in one and two dimensional 
potential energy landscapes and the folding process of small bio-polymers. We compare results 
for the mean first passage time and the mean folding time obtained with the Projective Dynamics 
method with those obtained by a direct measurement, and where possible with a semi-analytical 
solution. 

PACS numbers: 05.40.-a, 05.10.Gg, 05.10.-a, 02.50.Ga 
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INTRODUCTION 



The mean first-passage time (MFPT) is the time required for an ensemble of identical 
systems starting from a given initial distribution of configurations to reach a fixed criterion. 
Being able to obtain the MFPT is important in a wide array of physical applications. These 
include the MFPT when a star of a certain mass goes supernova, to neuron firing dynamics, 
spreading of diseases, chemical kinetics, folding processes of polymers, the death of living 
creatures, and the decay of metastable states via nucleation and growth processes [HIS]- The 
Projective Dynamics (PD) method to calculate MFPT for systems with a discrete state space 
[3Hn] mapped the MFPT problem for metastable decay of magnetic states associated with 
Ising-type (discrete spin states) models onto a nearest-neighbor coupled master equation. 
However, the PD method has not previously been shown to be valid for other dynamical 
systems, for example for systems with continuous state spaces [7]. The calculation of the 
MFPT for systems with long time scales has previously required that the dynamic system 
satisfy certain conditions. For example, for the milestoning method [8J to work the system 
must be close to equilibrium or have separation of time scales or committer surfaces. We 
prove in this letter that the PD method has no such constraints, and hence it is generally 
applicable to obtain the MFPT of any dynamical system. 

We prove that for any MFPT problem (with a finite MFPT) there exists a discrete master 
equation with nearest-neighbor coupling that has the same MFPT as the original system. 
This master equation has time-independent rates, even if the underlying system is non- 
Markovian. Every point in phase space in the original system must be mapped onto a state 
in the discrete master equation. We show that any mapping that leads to only nearest- 
neighbor coupling in the master equation preserves the MFPT provided the growing (gk) 
and shrinking (s^) rates between all master equation states k are correct. Therefore, whether 
the Qk and are known theoretically or are measured, the correct MFPT is obtained. For 
metastable decay in the ferromagnetic d=3 Ising case such knowledge enabled calculations 
of MFPT of about 10^" Monte Carlo steps per spin [5J . It is anticipated that the knowledge 
that the PD method gives the correct MFPT will enable long-time-scale simulations for 
other physical models. An example of where the PD method may be useful for long-time 
simulations is studies of the intercalation time of Li ions in molecular dynamics studies 
modehng charging of batteries [5] . 
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THEORY 



Consider any ensemble of systems evolving in phase space F under some dynamic. They 
start with some given distribution, and we desire to calculate the MFPT until each system 
stops after it meets some fixed stopping criterion. The dynamics of the ensemble can be 
mapped onto a set of discrete non-overlapping states {(k}, with 0<k<S, which cover the 
entire domain. We impose the restriction that the states can make transitions only to the 
states Cit±i- This condition can be met for many systems by adjusting the 'length' of the 
states, so that no transitions within a single time step dt further than to the neighboring 
states exist. The states that form the stopping citerion will all be mapped to Co- 

The time-evolution of the system can be described by a master equation with nearest 
neighbor coupling, which describes the change of occupation Pk{t) of state k by the proba- 
bility flows between adjacent states. Namely, 

^Pk{t) = gk+iPk+i{t) - [9k + Sk] Pkit) + Sk-iPk-iit), (1) 

where the growing gj. (shrinking Sk) rates represent the directional rates at which the system 
transits from state k to state A; — 1 (A; -|- 1). The initial conditions {Pfe(O)} are specified by 
the ensemble of initial conditions of the original system. 

Let N{k /c ± + dt) denote the number of times the system makes a transition 
from state k to its neighboring states {k ± 1) in the time interval {t,t -\- dt] and Nk{t) the 
number of times the system resides in state k at time t. Then the growing rate for the time 
interval {to, can be obtained by measuring the system at time intervals dt. Explicitly 

I'i^dtNik ^ k-l]t,t + dt) 
IC^tNkit) 

A similar expression exists for the shrinking rate Sk- 

Assuming that the ensemble of systems has been fully absorbed sA, te — oo after starting 
at to = 0, we write in shorthand the master equation 

^Pk{t)^Y.^{Kk')Pkit), (3) 

k' 

where the elements of W{k, k') are the growing and shrinking rates, which have been mea- 
sured from to = up to some point in time when all systems in the ensemble are fully 
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absorbed. By using the fundamental relation [TO] J2k'''ik)W{k,k') = —1, the general ex- 
pression for the MFPT r{So) for a system starting fully in state So can be obtained as 

So 



1=1 yi 
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i=l 





(4) 



where So denotes the starting state and 5* the total number of states within the domain. 

We prove that Eq. Q gives the same MFPT independent of the particular choice of 

the states. For this purpose, let m = A; IJ A; + 1 be the joined interval of state k and 

A; + 1, then for a single time step it follows that the transitions from state m to k — 1 

{k + 2) in the new system are equal to the transitions from state k to k — 1 (/c + 1 to 

k + 2) in the old system namely N{m — )■ k — l,t,t + dt) = N{k — k — l,t,t + dt) and 

N{m k + 2,t,t + dt) = N{k + 1— )'A; + 2,t,t + dt), whereas the probability of occupation 

of state m rescales as P„(t) = Pk{t) + Pk+i{t) = [Nk{t) + Nk+i{t)]/ J2kNk{t). Thus the 

growing rate at time t in the old and new system are related as 

„ Pkjt) 

^"^ Pk{t) + Pk^iit)^' 

and similarly for the new shrinking rate 

That this procedure leaves the MFPT unchanged can be understood by noting the effect 

of joining two states on the master equation. The joining of adjacent states corresponds to 

the addition of terms of the master equation of the same adjacent states, namely 

J^Pk{t) = gk+iPk+i{t) - [Qk + Sk] Pk{t) + su-iPk-i{t). (6) 

and 

d 

—Pk+i{t) = gk+2Pk+2{t) - [gk+i + Sk+i] Pk+i{t) + SkPk{t). (7) 
It is easily seen that the cross terms vanish and we are left with an expression of the form 

^Pmit) = gk+2Pk+2{t) - gkPkif) - Sk+lPk+lit) + Sk-lPk-lit). (8) 

Using ([5]) and similarly for Sm in ([s]) for a single time step, leads to 

^P„(t) = gk+2Pk+2{t) - [gm + Sm]Pm{t) + Sk-lPk-l{t)- (9) 

Hence the general form [compare Eq. ([T]) and ([6])] is restored in the reduced system of 
equations. Performing this joining repeatedly, finally only one state is left. This gives the 
same MFPT as the original ensemble of systems [1]. 
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FIG. 1: (color online) Kramer's and a rough potential. The states are chosen as intervals along 
the x-coordinate of some fixed length A/. 

COMPUTATIONAL STUDY/SIMULATION 

To illustrate the theoretical framework, we demonstrate diffusion in both dimensions d=l 
and d=2, as well as the folding process of a model for a small linear polymer chain. We 
choose these examples to specifically address the independence of the method from any 
existence or knowledge of a free energy landscape or most probable escape pathway. 

As a d=l historical example, we studied the diffusion process of particles subjected to a 
Kramers or to a rough [Hj potential (Fig. [T|. The trajectories were integrated along 5120 
individual paths starting at x=— 0.9 and terminated once they leave the domain (— oo, 0] at 
the absorbing boundary x = 0. The MFPTs were calculated using Eq. (|4]). In order to show 
the freedom in choosing the length of the intervals, we show examples of bins with different 
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lengths A/. Starting at the absorbing boundary k=0 for x>0, the system resides in state k 
when {k — l)Al < x < kAl. In both cases (smooth and rough), we chose Al = 0.1, 0.2 and 0.4 
[Fig. ([T])]. Table [l] shows the results obtained with the PD method are not changed with 
different interval lengths. A comparison with a direct measurement (on the underlying 
dynamics) and the semi-analytical solution further verifies that the MFPTs obtained with 
the PD method gives rehable results (provided that sufficient statistics are obtained to get 
accurate estimates of the growing and shrinking rates). Note that to illustrate the method we 
chose examples of the starting position being at the boundary between two states (A/ = 0.1), 
in the midrange [Al = 0.2), and away from the midrange {Al = 0.4) of the starting state. 
The results do not change with any of these starting positions, which further indicates the 
independence of the PD method. 

As a d=2 example we applied the PD method to the diffusion process at the entropic 
barrier Uentr{x,y) of Ref. [8]. We chose the coordinate C in two different ways. The trajec- 
tories are started at (xq, ?/o) = (— 0.5, 0) and terminated once they reach a;>0. We obtained 
results for defining the states both with the coordinate C=x and C=r [Fig. (|2|]. The first 
represents a binning along the x-coordinate, interpreted as the progress towards the absorb- 
ing boundary, while the circular binning has no such interpretation. For C=x the states were 
{k — l)Ax<x<kAx, where we chose Ax=0.065 and 0.13. For (=r, the states are defined as 
{S — k)Ar<r< {S — k + 1) Ar for 2 < k < S , where r denotes the distance from (xq, Uo)- We 
chose Ar=0.025 and 0.05. For the circular binning, the bin k=l is comprised of all points 
with x<0 outside the circular annulii. The results in Table [T] showing independence of the 
MFPT illustrate the strength of the PD method. 

As a polymeric example, we applied the PD method to the folding process of a model 
of a small linear polymer chain having the chemical structure {HP^)^H , where H stands 
for the hydrophobic and P for the polar monomers. The structure of the individual chain 
is maintained by three interatomic potentials: a bond-stretching potential, a bond-angle 
bending potential, and a rejecting potential avoiding an overlap of HP or PP monomers. 
The chain undergoes a folding process from the fully elongated state to a compact near native 
state caused by attractive Lennard- Jones type of interactions between HH monomers. The 
PD method is given by choosing the coordinate C, as the potential energy of the native 
contacts (the HH interaction energy). Although this choice seems apparent, it does not 
correspond to an actual dynamical coordinate. Starting with the fully elongated chain, for 
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TABLE I: MFPTs for (a) Kramer's potential, (b) rough 1 dim. (c) 2-dim. entropic barrier and (d) 
tlie folding of a polymer chain. The results of the Projective Dynamics method are given for their 
corresponding intervals = Al Kramer's, Ar and Ax 2-dim, and AU/Ch polymer. Also shown 
results obtained by direct measurement of the Brownian motion process and the semianalytical 
solution for the d=l absorption processes. 

different temperatures of the external bath, we simulated the folding process due to the 
Brownian motion. We compared the MFPTs of the chain of reaching a potential energy 
deep enough in the basin of attraction of the energy ground state (i.e. the native state) so 
that no escape (i.e. unfolding) from there is likely to occur. The results of the PD method 
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FIG. 2: (color online) The entropic barrier, the states are defined along the coordinate ( = x 
(representing a progress toward the absorbing boundary) and C, = r (representing circular intervals) 
of some fixed interval length = Ax and Ar. 

as well as a direct measurement are shown in Table [Tj For all simulated temperatures the 
PD method gives the same results (within statistics) as a direct measurement. 
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CONCLUSION AND DISCUSSION 



The Projective Dynamics (PD) method, as a tool for projecting multi-dimensional sys- 
tems onto one set of states {(k} and mapping the time-evolution onto a discrete master 
equation with nearest neighbor coupling, was shown to be independent of the choice in the 
states (k and the 'length' of the intervals which define the states. Provided only transi- 
tions between adjacent states occur, the PD method correctly obtains MFPTs. This result 
makes the PD method generally applicable to the dynamics of any system (discrete or con- 
tinuous, Markovian or non-Markovian, stochastic or deterministic). Subject only to the 
nearest-neighbor coupling constraint, the states {(k} can be chosen in multiple ways, with- 
out changing the mean first-passage time (MFPT). In many cases of interest, the average 
occupation probability for every state (k is also the same as for the original dynamical sys- 
tem. The calculation of the growing and shrinking rates required in the PD method may 
for some models and dynamics be obtained by using other methods, such as calculations of 
histories [12] or forward flux sampling [13] or accelerated molecular dynamics [HI [T3] . 
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